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Abstract — We consider communication over the binary erasure 
channel (BEC) using low-density parity-check (LDPC) code and 
belief propagation (BP) decoding. The bit error probability for 
infinite block length is known by density evolution |3| and it is 
well known that a difference between the bit error probability 
at finite iteration number for finite block length n and for 
infinite block length is asymptotically a/n, where a is a specific 
constant depending on the degree distribution, the iteration 
number and the erasure probability. Our main result is to derive 
an efficient algorithm for calculating a for regular ensembles. The 
approximation using a is accurate for (2, r)-regular ensembles 
even in small block length. 

I. Introduction 

In this paper, we consider irregular low-density parity- 
check (LDPC) codes flj with a degree distribution pair 
(A, p) |2). The bit error probability of LDPC codes over 
the binary erasure channel (BEC) under belief propagation 
(BP) decoding is determined by three quantities; the block 
length n, the erasure probability e and the iteration number 
t. Let Pb(n,e,t) denote the bit error probability of LDPC 
codes with block length n over the BEC with erasure prob- 
ability e at iteration number t. For infinite block length, 
Pb(oo,e, t) = lirrin^oo P b (n, e, t) can be calculated easily 
by density evolution [3| and there exists threshold parameter 
6bp such that lim^oo Pb(oo, e, t) = for e < ebp and 
limt^oo Pb(oo, e, t) > for e > ebp- Despite the ease 
of analysis for infinite block length, finite-length analysis is 
more complex. For finite block length and infinite iteration 
number, Pb(n, e, oo) = limt-nx, Pb(n, e, i) can be calculated 
exactly by stopping sets analysis f_6|. For finite block length 
and finite iteration number, P^(n,e,t) can also be calculated 
exactly in a combinatorial way [4]. The exact finite-length 
analysis becomes computationally challenging as block length 
increasing. An alternative approach which approximates the 
bit error probability is therefore employed. For asymptotic 
analysis of the bit error probability, two regions of e can be 
distinguished in the error probability; the high error probability 
region called waterfall and the low error probability region 
called error floor. In terms of block length, they correspond to 



the small block length region and the large block length region. 
This paper deals with the bit error probability for large block 
length both below and above threshold with finite iteration 
number. 

For infinite iteration number, the asymptotic analysis for 
error floor was shown by Amraoui as following jSJ: 



P b (n,e,oo) = - 



1 X'(0)p'(l)e 1/1 

2 1 - A'(0)p'(l)e n \n 



for e < e B p, 



as n — * oo. This equation means that for ensembles with A2 > 

°> 1 l-A'^i'me n is a 8 ood approximation of P b (n, e, 00) 
where n is sufficiently large. 

Our main result is following. 
For regular LDPC codes with finite iteration number 



P h (n,e,t) = P b (oc,e,i) + a(e,t)- +0 (- 

n \n 



for any e, 



as n — > 00, where a{e, t) — (3(e,t) +j(e,t) and /3(e, t) and 
"f{e,t) are given by Theorem\2\and Theorem\l\ 

This analysis is the first asymptotic analysis for finite 
iteration number. 

II. Main result 

The error probability of a bit in fixed tanner graph at the t- 
th iteration is determined by neighborhood graph of depth t of 
the bit [5|, [9|. Since the probability of neighborhood graphs 
which have k cycles is Q(n~ k ) we focus on the neighborhood 
graphs with no cycle and single cycle for calculating the 
coefficient of -nT 1 in the bit error probability. Let (3(e,t) 
denote the coefficient of -nT 1 in the bit error probability 
due to cycle-free neighborhood graphs and j(e,t) denote 
the coefficient of rT 1 in the bit error probability due to 
single-cycle neighborhood graphs. Then the coefficient of -nT 1 
in the bit error probability can be expressed as following: 
a(e, t) — f3(e, t) + 7(6, t). 7(5, t) can be calculated efficiently 
for irregular ensembles and (3(e,t) can be expressed simply 
for regular ensembles. 



The expected probability of erasure message for infinite 
block length can be calculated by density evolution. 

Proposition 1 (Density evolution [3]). Let Q(t) denote era- 
sure probability of messages into check node at the t-th 
iteration and P(t) denote erasure probability of messages into 
variable node at the t-th iteration for infinite block length. 
Then 



Q(t) = eX(P(t-l)) 



P(t) 



ift = Q 



1 — p(l — Q(t)), otherwise 



The coefficient of nT 1 in the bit error probability due 
to single-cycle neighborhood graphs can be calculated using 
density evolution. 

Theorem 1 (The coefficient of in the bit error probability 
due to single-cycle neighborhood graphs). 7(5, i)for irregular 
LDPC ensembles with a degree distribution pair (A, p) are 
calculated as following 



t-i it 



7(M) = 2 F i2(Mi,s 2 )+ 

si=l s 2 =2si + l 

t-1 2t 2t 

^34(i,si,s 2 ) + ^F 56 (i, S ) 



Sl =0s 2 =2si+2 s=l 

where F± 2 , -F34 and F^q is Eq. (fJJ, (0 and (0, respectively. 



The complexity of the computation of ~f(e,t) is 0(t ) in 
time and 0(t 2 ) in space. 

P(e, t) can be expressed simply for regular ensembles since 
of uniqueness of the cycle-free neighborhood graph. 

Theorem 2 (The coefficient of rT 1 in the bit error probability 
due to cycle-free neighborhood graphs for regular ensembles). 

(3{e,t) for the (l,r)-regular LDPC ensemble is expressed as 
following 

eP(f)'. 

Outline of the proof: The probability of the unique cycle- 
free neighborhood graph of depth t is 

, l-((l-l)(r-l)}' ., , l-|(l-l)[r-l)}' 



Jr 



1-{(1-1)(7— 1)}' 



where E = nl. The coefficient of -nT 1 in the probability is 

2 v ' l-(Z-l)(r-l) u A n 

and the error probability of the root node is eP(t) 1 . Then we 
obtain the statement of the theorem. ■ 
Due to the above theorems, a(e, t) for regular ensembles 
can be calculated efficiently. 



f(t,s,p) 
H(u, t, s) 
Gi(u,t,s) 
G 2 (u,t) 
G' 2 (u,t) 

H 2 (t,s) 
Fi 2 (t, st, s 2 ) 

F3 i (t,s 1 ,s 2 ) 
F 56 (t,s) 



if t = 



P, 



if s = 



^lg(t,s-l,p), otherwise' S ' P) * \ 1 - (1 _ f{t 1, Sjp))> otherwise 

^jfG 2 («,«), ifs = 

^A /j (i) s ~ ■*-)' otherwise 

G£(i,tt), ifs = 

A _ u _ t + Sj !) + £^±_Qp_ H ^ t- l,a-\), otherwise 

1, if t = u + 1 

(l - £ ^ £li ) 9(u, t-u-l,1) + E^^ e hV^m G2(U; t _ 1} , oth e rw ise 

1, if t — u 

(l - 9(u,t- u, 1) + ^g^e^^G' 2 (u,t- 1), otherwise 



p"(i-QW) 



1 - 



p"(i) 
(i-QO 
P "(i) 



(1-e 



V(P(t-l)) ^ 
A'(l) ' 



if s = 1 



p " (1 ' 9(t)) ' 1 - 2/(f - 1, s, 1) + e X{P J t - ) 1)) H(t - 1, t - 1, s - 1) ) . otherwise 



A"(l)p'(l) 2 (A'(l)p'(l))^- s - 2 g(t + l) 

t, si - 1, 1 — - [ 1 - e Gi(t - si, t - si, s 2 - 2si - 1) 



A"(l) 



-p"(l)A'(l)(A' (l)p'(l)Y^- 2 Q(t + l)g (f, Sl ,ff 2 (i - Sl , s 2 - 2 Sl - 1)) 
i(A'(iy(l)) s iJ(i,M) 



(1) 

(2) 
(3) 



h 



h h h h h h h 




marginalized 
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Fig. 1. The left figure is the neighborhood graph of depth 1. White variable node is the root node. The variable nodes in depth 1 have degree l\ to Is- We 
consider summing up the probability of all nodes and the type of marginalized graph in the right figure. 



Proposition 2 (The bit error probability decays exponentially 

[9 1). Assume e < eep. Then for any 8 > 0, there exists some 
iteration number T > such that for any t > T 



P(t)<P(T)(X'(0)p'(l)e + S) 
P(t)>P(T)(\>(0)p'(l)e-5) 



t-T 



t-T 



Although if A'(0)A'(iy(l) 2 e < 1 then (3{e,t) converges 



A'(0)//(l)e 



as t 



oo, if 



to and j(e,t) converges to \t -\>(o) p >{i)z 
A'(0)A'(l)//(l) 2 e > 1 then (3(e,t) and 7 (e,t) grow expo- 
nentially as t — > oo due to the above proposition. Thus 
convergence of a(e, t) is non-trivial. In practice it is necessary 
to use high precision floating point tools for calculating a(e, t). 

III. Outline of the proof of theoremQ] 

The bit error probability of an ensemble with iteration 
number t is defined as following: 

P b (n,e,t)4 F„(G)P b (G), 

where Qt denotes a set of all neighborhood graphs of depth t, 
P rt (G) denotes the probability of the neighborhood graph G 
and Pb(G) denotes the error probability of the root node in 
the neighborhood graph G. The coefficient of nr 1 in the bit 
error probability with iteration number t due to single-cycle 
neighborhood graphs is defined as following: 



E 

Ges t 



7(M)= lim n V P„(G)P b (G) 



where St denotes a set of all single-cycle neighborhood graphs 
of depth t. 

First we consider the bit error probability of the root node 
of the neighborhood graph G in Fig. Q] The variable nodes in 
depth 1 have degree 1% to ig. Then the coefficient of -nT 1 in 



i(G) is given as 
lim n¥ n (G) = 



7/(1) 



L3P3P5P4 

A; 1 A/ 2 A; 3 A; 4 Ai 5 A; 6 A/ 7 A; s (/4 — 1). 



The error probability of the message from the channel to the 
root node is e. The error probabilities of the message from the 
left check node, the right check node and the middle check 
node to the root node are (1 — (1 — e) 2 ), (1 — (1 — e) 3 ) and 
(1 — (1 — e) 3 ), respectively. Then the error probability of the 
root node is given as 

P b (G) = 6(1 - (1 - e ) 2 )(l - (1 - e ) 3 )(l - (1 - e) 3 ). 

The coefficient of n" 1 term of the bit error probability due to 
G is given as 

lim nP„(G)P b (G) = 



1 



7/(1) 



i3P3P5P4A/ 1 Aj 2 A; 3 Ai 4 Aj 5 Aj 6 Aj 7 A; s (Z4 — 1) 



£ (l-(l- e ) 2 )(l-(l-e) 3 )(l-(l-6) 3 ). 
After summing out the left and right subgraphs, 



1 



-L 3 p 5 A ;3 A i4 A ;5 (/4 - l)e(l - (1 - ef)P(lf 



7/(1) 

After summing out degrees 1$, I4 and I5, 

' -L 3 p5A'(l)6(l-(l- e )(l-Q(l)) 2 )F(l) 2 . 



L'(l 



At last, after summing out the root node and the middle check 
node, 

E - C 1 - 0(l)) r_S (l - £ )) 



'(1) 

piiy-H 



r - 1 



X ' a) -L'(P(l))e(p"(l)-p"(l-Q(l))(l-e)) 



21/(1) 



P"(l-Q(l)) 
p»(l) 



(l-e) 



The coefficient of n 1 in the bit error probability for iteration 
number t due to neighborhood graphs with the right graph 



9 V V 9 

s% = 1, S2 = 6 si = 1, S2 — 5 si = 0, S2 = 4 si = 0, S2 = 5 s = 6 s = 5 

Fig. 2. Six types of marginalized single-cycle neighborhood graphs. These are distinguished in which variable node, check node or root node are bifurcation 
node and which variable node or check node are confluence node. Depth of the bifurcation node corresponds to s\. The number of nodes in the minimum 
path from root node to confluence node corresponds to S2 and s. 



type in Fig. Q]is given as 
^AW(l) 

L'(P(t)) ( P "(l-Q(t)) ( X'(P(t-l)) \\ 

1/(1) \ p"(l) \ A'(l) )) 

= ±\'(l)p"(l)Q(t+l)g(t,0,H 2 (t,l)) 
= F 34 (t,0,2) 

in the same way. Notice that ^X'(l)p"(l) is the coefficient of 
n^ 1 of the probability of neighborhood graphs with the right 
graph type in Fig. Q] 

Single-cycle neighborhood graphs can be classified to six 
types in Fig. [2] Summing up the bit error probability due to 
all these types, we obtain -f(e, t). Left two types correspond to 
F%2, middle two types correspond to F34 and right two types 
correspond to F$q. 

IV. Numerical calculations and simulations 

There is a question that how large block length is neces- 
sary for using Pb(oo, e, t) + a(e,t)^ for a good approxi- 
mation ofPb(n,£,t). It is therefore interesting to compare 
Pb(oo,e, t) + a(e,t)— with numerical simulations. In the 
proof, we count only the error probability due to cycle-free 
neighborhood graphs and single-cycle neighborhood graphs. 
Thus it is expected that the approximation is accurate only 
at large block length where the probability of the multicycle 
neighborhood graphs is sufficiently small. Contrary to the 
expectation, the approximation is accurate already at small 
block length in Fig. [3] Although there is a large difference 
in small block length near the threshold, the approximation is 
accurate at block length 801 which is not large enough. 

For the ensembles with A2 = 0, the approximation is not 
accurate at e far below the threshold in Fig. [4] Since \a(e, t)\ 
decreases to as t — > 00 for the ensembles the higher 
order terms caused by multicycle stopping sets has a large 
contribution to the bit error probability. It is expected that the 
approximation is even accurate for the ensembles from which 
stopping sets with small number of cycles are expurgated. 



The limiting value of a(e, t), a(e, 00) = Hindoo a(e, t) 
is also interesting. For a(e, 00), calculate a(e, t) where suf- 
ficiently large t in Fig. [5] and Fig. [6] For the (2, 3)-regular 
ensemble below the threshold, a(e, 00) and \ ^^ym; 
take almost the same value. It implies that below threshold 
rt(Pb(n, e, t) — Pb(oo, e, t)) takes the same value at two limits; 
n — > 00 then t — -> 00 and t — * 00 then n — » 00. For the 
ensembles with A2 = 0, a(e, 00) is almost where e is smaller 
than threshold. 

At last, notice that a(e,t) takes non-trivial values slightly 
below threshold. For the (3, 6)-regular ensemble, a(0.425, t) 
is negative at t < 39, positive at 40 < t < 52 and has 
absolute value which is too small to be measured at t = 53. 

maxi< t <53 |a(0.425,£)| = 35710.34 at t = 42. 




0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65 



Fig. 3. Comparing Pt,(oo, e, t) + a(e, t)— with numerical simulations for 
the (2, 3)-regular ensemble with iteration number 20. The dotted curves are 
approximation and the solid curve is density evolution. Block lengths are 5 1 , 
102, 201, 402 and 801. The threshold is 0.5. 

V. Outlook 

Although the asymptotic analysis of the bit error probability 
for finite block length and finite iteration number given in this 
paper is very accurate at (2, r)-regular, much work remains 




0.45 



Fig. 4. Comparing Pb(oo, e, t) + ot(e,t)^r with numerical simulations for 
the (3, 6)-regular ensemble with iteration number 5. The dotted curves are 
approximation and the solid curve is density evolution. Block lengths are 512, 
2048 and 8192. The threshold is 0.42944. 



to be done. First there remains the problem to computing 
P(e, t) for irregular ensembles. It would also be interesting 
to generalize this algorithm to other ensembles and other 
channels. 

In the binary memoryless symmetric channel (BMS) 
parametrized by e G [0, oo), We consider inf t Ph(n, e, t) 
instead of lim^oo Pb(", e, t) since of lack of monotonicity. 
The asymptotic analysis of the bit error probability with the 
best iteration number t*(n, e) = arginf t Pb(^, e, t) under BP 
decoding was shown by Montanari for small e as following 
0: 

1 00 1/1 
P b (n, e, t*(n, e)) = - (0)^(1))** - +ol- 

i=0 ^ 

as n — > oo, where p, = Pr(Z t < 0) + ± Pr(Z t = 0) and Zi 
is a random variable corresponding to the sum of the i i.i.d. 
channel log-likelihood ratio. It implies that if A2 > 0, the 
asymptotic bit error probability under BP decoding is equal 
to that of maximum likelihood (ML) decoding. Although the 
condition of the proof in |5| implies the convergence of values 
corresponding to (3(e,t) and 7(e,t) in this paper, in general 
if A'(0)A'(l)//(l) 2 93(e) > 1, they do not converge, where 
05(e) is Bhattacharyya constant. Although the condition of e 
is strong, the approximation is very accurate for all e smaller 
than threshold. We have the problem to prove the convergence 
of a(e, t) for the BEC and the BMS for any e < e B p. 

A iteration number is also important. The approximation is 
not accurate for too large iteration number. A sufficient (and 
necessary) iteration number for a given block length and a 
ensemble is very important to improve the analysis in this 
paper. 
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Fig. 5. Comparing a(e,oo) with ^ i-y (o)p^(i)c ^ or ^ e (2, 3) -regular 
ensemble. Below the threshold 0.5, they take almost the same value. 
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